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SUttlARY 

A simple  procedure  for  consideration  of  specified  treatment  contrasts  or 
sets  of  contrasts  in  a paired  comparisons  experiment  is  developed.  General 
likelihood  estimation  and  likelihood  ratio  tests  are  given.  Specified  treatment 
comparisons  as  appropriate  in  a particular  experiment  may  be  made.  The  procedure 
may  be  used  for  consideration  of  factor  effects  and  interactions  when  the  treat* 
ments  in  paired  comparisons  are  factorial  treatment  combinations.  An  example 
is  given  of  a taste  preference  experiment  on  coffee  with  factors,  brew  strength, 
roast  color  and  brand,  each  at  two  levels.  Results  are  summarized  in  an 
analysis  of  chi. square  table  very  analogous  to  the  typical  analysis  of  variance 
summary. 
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1 . INTRODUCTION 

Bradley  and  Terry  (1952)  presented  a model  and  a method  of  analysis  for 
paired  comparisons  generalized  slightly  by  Dykstra  (1960).  In  the  basic  experi- 
ment, t treatments,  T^,  T^,  are  compared  with  n^  comparisons  of 

and  Tj,  n^  £ 0,  i < j,  i,j  = 1,  ....  t.  Some  of  the  comparison  sizes  n^ 
may  be  zero  but  linkage  of  comparisons  is  required  in  the  sense  that  there  must 
not  be  any  subset  of  the  treatments  for  which  no  treatment  is  compared  with  any 
treatment  of  the  complementary  subset.  The  model  postulates  the  existence  of 
treatment  parameters,  *.  for  T., , tt^  i 0, 

l - 1 , (1.1) 

i 

such  that  the  probability  of  selection  of  T^  from  the  pair  (T^T^),  j j*  i, 
is 


PON  > Tj)  - iri/(iri  + ik)  . 


(1.2) 


Likelihood  methods  were  used.  On  the  assumption  of  independence  of  selec- 
tions, the  likelihood  function  is 


a. 

LW  * n n.  V n (n.  + ti.) 
i > ' i< ) 1 y 


n. . 
ID 


(1.5) 


where  is  the  total  number  of  selections  of  in  the  entire  experiment, 

i ■ 1,  ...»  t,  J a,  ■ \ n. . , and  ti’  * (ti.,  ...,  n.).  Vihen  L(ir)  is  maximized 

i 1 i<j  13  “ 1 z 

subject  to  (1.1)  as  a constraint  and  if  is  the  likelihood  estimator  of 
(and  £ of  tt)  , the  likelihood  equations  are 


»*  • j 

_ y*  . , . Aj — B o i = i t 

p.  4 P.  + p.  * 1 z * 

J 1 D 


n. 


(1.4) 


i 1 


i 


4 


1 

4 


(1.5) 
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where  J'  represents  a sum  with  j t i.  Bradley  (1975)  has  summarized  the 

various  bases  for  the  model  and  results  associated  with  it,  giving  an  extensive 
bibliography. 

In  applications,  situations  arise  in  which  special  comparisons  or  contrasts 
among  treatments  are  of  interest.  Abclson  and  Bradley  (1954)  considered  the 
2x2  factorial  and  El-lle lbawy  (1974)  the  2m  factorial.  This  paper  considers 
orthogonal  treatment  contrasts  more  generally  and  the  results  may  be  applied  to 
any  set  of  factorial  treatment  combinations.  The  factorial  models  attempted 
earlier  have  been  modified  and  simplified  although  numerical  results  in  applica- 
tions are  closely  similar. 

David  (1963,  Section  4.1)  noted  that  the  basic  method  is  unchanged  if  (1.1) 
is  replaced  by  other  scale-determining  constraints  and  suggested 

\ in  v.  • 0 . (1.6) 

i 1 

Bradley  (1953),  in  comparing  the  method  with  that  of  Thurstone  (1927),  suggested 
that  tn  in  plays  the  role  of  a location  parameter  for  T^.  Treatment  contrasts 
will  be  specified  as  linear  contrasts  among 

* In  tk  , i = 1,  t . (1.7) 

2.  LIKELIHOOD  GST  I FIAT  I ON 

Let  3 bo  an  m x t matrix,  0 s m s (t  - 1) , with  zero-sum,  orthonormal 
nn 

rows.  Let  y_(tt)  and  Y_(p)  be  the  column  vectors  with  i-th  elements  y ^ in 
(1.7)  and  In  p^  i ■ 1,  ....  t;  let  r_  bo  an  m-element  column  vector  with 
elements  r.,  lc  ■ 1,  ...,  m,  to  be  used  as  Lagrange  multipliers;  and  let  0 
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antl  1^  be  respectively  column  vectors  of  m zero  elements  and  t unit  elements. 
The  general  estimation  problem  is  to  find  estimators  p^  of  i ■ 1,  . ..,  t, 

or  £ of  jt,  maximizing  L(ir)  in  (1.3)  subject  to  the  constraints. 


(2.1) 


incorporating  (1.6).  Thus,  using  the  method  of  Lagrange  multipliers,  we  maximize 


QOr)  - I*  L(nJ  ♦ l' (*) t !*.£;] 


(2.2) 


subject  to  (2.1).  Throughout  this  work  ue  assume  that  pi  > 0,  i «*  1,  ...»  t; 
Ford  (1957),  in  showing  convergence  of  an  iterative  solution  to  (1.4)  and  (1.5) 

• l 'i  f>  ■ . i •*,  • • . , . 

assured  this  by  the  following  Ford  Condition:  In  every  possible  partition  of 

the  t treatments  into  two  non-empty  subsets,  some  treatment  in  the  second 
subset  has  been  preferred  at  least  once  to  some  treatment  in  the  fiTst  subset. 


■ \ - r ■ 1 ’ 1 * * 

and  lot  E(p)  be  the  t-elouent  -ulumn  vector  with  elements  in  (2.3).  The 
equations  necessary  for  maximization  of  Q(ir)  reduce  to 


(2.3) 


1 (11)  ♦ “ 5*  » 


(2.5) 
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together  v/ith  the  scale-determining  equation. 


I tn  p.  = 0 (2.6) 

or  (1.5)  as  desired;  it  is  easy  to  show  that  r » 0.  Multiplication  on  the 

v 

left  of  (2.4)  by  B shows  that  £ = -B  n(j>)  and  that  (2.4)  reduces  to 


(i,  - «(E)  - fi. 


where  r is  the  t * t identity  matrix.  Let 


D » 1L  - Bj.B 


(2.7) 


(2.8) 


with  typical  element  . Then  (2.7)  may  be  rewritten 

tl . 

- <(,  (£)  - 0 , i = 1,  ....  t , (2.9) 

pi 

where 


r 

. p- 

j 


i J 


r ¥*> 


D.  . 
-JJL 
D. . 

li 


(2.10) 


Note  that  >0,  m = 1,  ...,t-2.  VJhen  m * (t  - 1),  a deterministic 
solution  follows  from  (2.1)  alone  - each  y^  « 0,  ■ 1 or,  v/ith  scale  adjust- 

ment, each  it,  = l/t.  VJhen  m * 0,  B is  non-existent  and  (2.4)  or  (2.7) 
reduces  to  (1.4)  or  we  may  use  (2.9)  with  D„  =0,  i / j,  ■ 1, 
i,j  3 1,  ....  t,  in  (2.10).  An  iterative  solution  to  (2.9),  (2.5),  and  (2.6) 


is  considered  now. 
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3.  ITERATIVE  SOLUTION  OP  LIKELIHOOD  EQUATIONS 

Let  and  satisfying  (2.S)  and  (2.6)  be  initial  and  r-th 

i’O) 

approximations  to  £,  the  solution  of  (2.9),  (2.5),  and  (2.6).  That  nv 
exists  is  clear  because  E.^  ■ _1^.  meets  tho  requirements.  The  means  of 
obtaining  from  are  described. 

Think  of  r * t(J  - 1)  ♦ j - 1,  J ■ 1,2,3,  ...,  j ■ 1,  ...,  t;  J indi- 
cates a cycle  of  iterations  and  j,  the  step  in  the  J-th  cycle.  To  initiate  the 
calculation  of  from  ]>^,  calculate  <Jk(£^)  from  (2.10)1  Thd 

iteration  is  done  by  calculation  of 


p.Cr+1)(k)  - exp  [In  pfr)  ♦ (Jj)\<r)(D..  - I)]  , i - 1,  ....  t , (3.1) 

1 1 } *J  * 


for  successive  values  of  k,  k - 0,1,2,  ....  where 

,(*)  ^ a 


f £n[a./p}rj  ♦j(2,w)J  if 

•*  I 1 otherwise. 


i?)  - < 


(3.2) 


When  aj/pjr^  • $j(E^)i  if  this  occurs  for  t successive 

values  of  r,  « p.  VJhen  a./p?r^  i $.(£^),  confute  (k)  and 

J J J 

L(£^r+1^(k)]  for  k ■ 0,1,2,  ...  until  a value  k*  of  k is  found  for  which 

L[E(r+1)  (k*)l  > ME(r))*  ,fhen 


£(r+l) 


El-Helbawy  and  Bradley  (1975)  show  that  k*  exists  and  examine  the  convergence 
of  this  iterative  process.  The  procedure  is  easy  to  program  on  a computer. 

Note  that  £^r+^  satisfies  conditions  (2.5)  and  (2.6)  if  £^  does. 
'»his  is  demonstrated  easily  for  £^r*^(k)  for  all  k through  use  of  (3.1), 
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thc  orthononiality  of  *he  rows  of  B , and  the  fact  that  B has  zero-sum  rows. 

-m  — m 

Note  also  that  if  n ■ 0,  = 0,  i i j , = 1,  i,j  = 1,  ...,  t,  k = 0,  and 


then  >0  and 


4?r:cr*l  * pir+1)  “ pir)cr+l  * 1 * j 


i>j(£v 


where 


'r+1 


a. 

.tr)  A V (r). 


1-1/t 


L»J  *j<t  ’ J 


is  such  that  n pfr+^  * 1.  Then  the  iterative  procedure  is  equivalent  to  the 
i 

one  suggested  by  Bradley  and  Terry  (19S2)  and  shown  to  converge  by  Ford  (1957). 


4.  INFERENCE  AND  FACTORIALS 


Likelihood  estimation  and  likelihood  ratio  tests  were  proposed  by  Bradley 
and  Terry  in  consideration  of  the  basic  model  for  paired  comparisons  used  here. 

In  extending  those  results,  we  can  formulate  a single  test  procedure  that  may 
be  used  to  test  particular  treatment  contrasts  or  for  the  analysis  of  factorial 

treatment  combinations. 


Consider  two  matrices  B and  B . 

— m -m+n 


where  0sm<m+n<  (t 


1), 


B defined  as  before  and  B„  having  zero-sum,  orthonormal  rows,  .We  assume  that 
— m —m+n  0 

Bv(tt)  » 0 and  test  the  hypothesis, 

"Tlr"  " fll 


1I„:  B v (it)  = 0 

0 -n-1--4 * * 7  -n  ’ 


(4.1) 
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against  the  alternative, 

"a-  • C-2) 

Let  it  ■ p-  maximize  L(tt)  given  3 y_(tt)  * 0 and  (1.6)  and  let  n « p 

— —a 

maximize  L(n)  given  D^yCtt)  » 0^  and  (1.6);  both  £q  and  may  be 
obtained  through  use  of  the  likelihood  estimation  procedure  given  in  Sections 
2 and  3.  The  likelihood  ratio  statistic  for  testing  1L  versus  H given 

" 5m  is 

-2  in  K • -2[iii  L(p0)  - in  L(n  )]  (4.3) 

which,  for  large  values  of  the  n„  , has  the  central  chi-square  distribution 

with  n degrees  of  freedom  as  its  limiting  distribution  under  HQ.  IThen 

m * 0 and  n » (t  - 1),  the  original  chi-square  test  with  (t  - 1)  degrees  of 

freedom  for  treatment  equality  is  obtained.  The  test  based  on  (4.3)  may  be  used 

to  partition  that  chi-square  with  (t  - 1)  degrees  of  freedom  into  several 

independent  and  additive  chi-squares  for  properly  chosen  and  sequenced  ortho- 

normal  sets  of  contrast  hypothesesand  designated  assumed  null  contrasts. 

An  iuportant  and  natural  application  of  the  technique  developed  is  to 

experiments  wherein  the  treatments  constitute  a full  or  fractional  set  of 

factorial  treatment  combinations.  Tests  of  factorial  effects,  main  effects 

and  interactions,  may  be  made  directly  based  on  (4.3)  and  suitably  chosen  rows 

for  B and  B . Alternatively,  the  paired  comparisons  model  may  be  reporam- 
— in  — m+n 

eterized  to  introduce  factorial  parameters. 

Consider  a q-factor  mixed  factorial  for  which  factor  s has  bs  levels, 
bs  i 2,  s ■ 1,  ....  q and  let  a ■=  (a^,  ....  a^)  be  a vector  designating  the 


levels  of  the  q factors  for  a particular  treatment  combination.  Now  replace 

q 

T.  by  T and  tt.  by  n ; if  a full  factorial  is  considered,  t =>  n b . 
l ai'ci  ’ , s 

— — s=l 

Factorial  parameters  are  introduced  roultipl icativcly;  take 


1.  1110 
it  = n ti  1 n tt 

a . a.  . . a.  a. 

” X1  X1  X1  x2  X1  x2 


i,  • • *1 

n tt  1 r 

. a.  • * *a. 

1,<...<1  l,  l 

1 r 1 r 


1 • • *q 

• ■ • TT 


(4.4) 


lr*,ir 

for  all  a where  1 i i.  < ...  <i£q,  r = 1,  ...,q,  and  tt 

— 1 r n ” a.  •••a. 

X1  xr 

represents  the  r-factor  interaction  (main  effect  if  r = 1)  of  factors 

i.,  ...»  i at  levels  a.  , ....  a.  . The  new  factorial  parameters  are 
1 r X1  xr 

q q q 

n (1  ♦ b ) - 1 in  number  and  must  be  subject  to  [n  (1  + b ) - n b] 
s=l  s s=l 


5 s-1  s 


functionally  independent  constraints.  But  (4.4)  is  linear  in  the  logarithms  of 
• arametexs.  The  system  is  exactly  analogous  to  that  of  the  analysis  of  variance 
(anova)  of,  say,  a randomized  complete  block  design  with  the  same  factorial 
treatment  combinations.  The  anova  constraints  on  anova  factorial  parameters 

VMir  V’^r 

apply  to  the  in  tt  . If  p is  the  likelihood  estimator  of 

rr  ' cc.  • • «a.  1 at.  •••<*, 


Vxr 


X1  Xr 


xl**’xr 


i.  i 
1 r 


, in  n is  the  same  linear  function  of  the  in  n as  is 

a.  •■•a.  1 a.  • • “U . a 


i.  l 

1 r 


X1  xr 


the  anova  estimator  of  the  corresponding  anova  interaction  parameter  of  the 
anova  treatment  effects  estimators.  Known  algoritluns  for  the  analysis  of 
factorial  experiments  may  be  applied  in  the  analysis  of  factorial  treatment 
combinations  in  paired  comparisons.  An  hypothesis  of  no  r-factor  interaction 
among  factors  i^,  ...,  iy  is  formulated  by  the  specification  that  the  usual 

r i • 0 » i 

1 r 

n (b.  - 1)  interaction  contrasts  among  the  in  n arc  zero,  a 

,i  ^ a.  •••a. 

s=l  s i,  i 


specification  equivalent  to  the  requirement  that  each  Zn  ir^  * 0 in 


1,  1 

1 r 


VS- 

view  of  the  parameter  constraints  or  that  tt  ■ 1 for  a.  • 1,  ...»  b,  , 

V\  s 9 


s * 1,  . . . , r. 

It  has  been  seen  that  likelihood  estimators  £ of  parameters  £ under 


constraints  (2.1)  may  be  found  for  various  choices  of  B . In  each  such  situation, 

—m 


multivariate  normal  distributions  may  be  specified  for  the  large-sample  distri- 
butions of  AT  (£  - n)  or  of  AT  - yOOJ  viith  means  zero  and  determined 


variance- covariance  matrices  where  n. . » NX. X. ...  + x.. 

13  xjN’  i3N  ij 


as  N * Y n.  Large 
i?j  13 


sample  variances  and  covariances  for  specified  treatment  contrasts  may  be  found 
and  power  functions  for  local  alternatives  for  tests  based  on  (4.3)  may  be  speci- 
fied. While  these  results  are  needed  in  some  aspects  of  data  analysis  for 
paired  comparisons , they  will  be  given  by  the  authors  in  a subsequent  paper. 


S.  EXAMPLE  - A ?3  FACTORIAL 

Brew  strength,  roast  color,  and  coffee  brand  were  tho  three  factors,  each 
at  two  levels,  ir.  an  exaaple  of  the  use  of  paired  comparisons  with  factorial 
treatment  combinations  in  consumer  preference  testing.  Twenty-six  preference 
judgments  were  obtained  on  each  of  the  28  possible  treatment  comparisons.  The 
data  are  summarized  in  Table  1.  The  three-element  vectors  £ and  designate 
the  treatment  combinations. 
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TABLE  1 - Preference  Data  in  Coffee  Testing 


1 


Preferred 
Treatment  T 

(X 

Treatment  Not  Preferred 
Ti 

Total 

Preferences 

a. 

0:  000 

001 

010 

011 

100 

101 

110 

111 

V 

000 

0 

IS 

15 

16 

19 

14 

19 

16 

114 

001 

11 

0 

10 

15 

15 

14 

15 

12 

92 

010 

11 

16 

0 

IS 

15 

14 

18 

15 

104 

011 

10 

11 

11 

0 

14 

11 

15 

13 

85 

100 

7 

11 

11 

12 

0 

9 

14 

13 

77 

101 

12 

12 

12 

15 

17 

0 

16 

18 

102 

110 

7 

11 

8 

11 

12 

10 

0 

12 

71 

111 

10 

14 

11 

13 

13 

8 

14 

0 

83 

Data  provided  through  the  courtesy  of  Navis  B.  Carroll  and  John  C.  Heimlich 
and  of  the  General  Poods  Corporation. 


Consider  the  matrix. 


B 


•7 


1 

1 

1 

1 

-1 

-1 

-1 

-1 

1 

1 

-1 

-1 

1 

1 

-1 

-1 

1 

-1 

1 

-1 

1 

-1 

1 

-1 

1 

1 

-1 

-1 

-1 

-1 

1 

1 

1 

-1 

1 

-1 

-1 

1 

-1 

1 

1 

-1 

-1 

1 

1 

-1 

-1 

1 

1 

-1 

-1 

1 

-1 

1 

1 

-1 

(5.1) 
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The  overall  test  of  treatment  preference  equality,  equivalent  to  that  of  Bradley 
and  Terry  (19S2),  is  obtained  from  (4.3)  v/ith  in  (4.1)  equal  to  in 
(5.1)  and  a ■ 0.  Under  the  null  hypothesis  (4.1),  each  ir  ■ 1 and  L(j>q)  in 
(4.3)  i$  L(lg)  - the  scale  constraint  (1.6)  is  used  instead  of  (1.1).  In  the 
analysis  summary  of  Table  2,  -2  in  L(_lg)  is  given  in  the  first  row.  Under 

the  alternative  hypothesis  (4.2),  m « O'  and  does  not  exist;  L(n)  is 
maximized  subject  only  to  (1.6)  with  the  resultant  values  of  and  -2  in  LQi^) 
given  in  row  2 of  Table  2,  The  chi-square  statistic  of  (4.3)  is,  by  subtraction, 

29.58  v/ith  7 degrees  of  froedom.  This  value  is  shown  in  the  totals  roi^s  of 

\ 

analysis  of  chi-square  Tables  3 and  4. 

The  total  chi-square  may  be  partitioned  in  various  ways,  two  of  which  are 
shown  in  Tables  3 and  4.  V.'e  give  details  on  Table  3 and  leave  the  reader  to 
check  Table  4.  Hypothesize  no  three- factor  interaction.  Then  3^  ■ 1^(7),  the 
last  row  in  (5.1),  m » 0,  does  not  exist  and  Bja+n  « 3^(7).  Values  of 
£ and  -2  in  L(ji)  under  llQ  are  given  in  row  3 of  Table  2.  The  chi-square 
statistic  of  (4.3),  now  with  1 degree  of  freedom,  is  the  difference  of  entries 
-2  in  L(j)  in  rows  2 and  3 of  Table  2,  the  value  being  0.63.  How  assume  no 
three-factor  interaction  and  hypothesize  no  two-factor  interactions;  ■ B^(7) , 
Un  " .23(4,5,6),  3^+n  ■ 84(4,5,6,7),  tho  arguments  of  £ indicating  the  rows 

chosen  from  (5,1).  The  required  chi-squared  statistic  from  (4.3)  has  3 degrees 
of  freedom  and  the  value  15.34  from  rows  3 and  4 of  Table  2.  This  chi-square 
may  be  partitioned  in  a number  of  ways  and  we  choose  only  one  of  them.  Chi- 
square  statistics,  each  with  1 degree  of  freedom,  are  calculated  for  the  following 
hypotheses  and  assumptions:  (i)  No  brand,  roast  color  interaction;  no  three- 

factor  interaction  assumed,  (ii)  No  brand,  brew  strength  interaction,  no  three- 
factor  interaction  and  no  brand,  roast  color  interaction  assumed,  (iii)  no  roast 
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color,  brew  strength  interaction;  no  three-factor  interaction,  no  brand,  roast 
color  interaction,  and  no  brand,  brew  strength  interaction  assumed.  The  matrices 
JSm*  “d  3^  respectively  are  (i)  1^(7),  5^(6),  £2(6,7),  (ii)  B2(6,7), 

B^(5),  65(5,6,7),  (iii)  B^(5,6,7),  B^(4),  £^(4, 5,6, 7).  Pertinent  row  pairs 
in  Table  2 are  (i)  3,5,  (ii)  5,6,  (iii)  6,4  and  the  chi-square  values  are 
0.22,  14.96,  0,15,  Three  remaining  degrees  of  freedom  arc  for  tests  on  main 
effects.  The  following  hypotheses  and  assumptions  arc  ysed:  (iv)  No  brand 

effect,  no  interactions  assumed;  (v)  No  roast  color  effect;  no  brand  effect 
and  no  interactions  assumed;  (vi)  Ho  brew  strength  effect;  no  roast  color 
effect,  no  brand  effect  and  no  interactions  assumed.  The  matrices  B , B and 
B^+n,  the  row  pairs  of  Tabic  2 and  the  corresponding  values  of  chi-square, 
each  with  1 degree  of  freedom,  are  as  follows:  (iv)  B- (4 ,5,6,7) , (3) , 

85(3.4,5,6.7),  4,  7,  0.04;  (v)  65(3,4,5,6,7),  £^2),  55(2,3,4,5,6,7),  7,  8, 

4.29;  (vi)  55(2,3,4,5,6,7),  £j(l),  £7 « 8,  1,  9.28.  These  results  are  given  in 
Table  3.  The  alternative  analysis  of  Table  4 is  based  on  rows  1,  2,  9-14  of 
Table  2. 

The  analyses  of  Tables  3 and  4 are  remarkably  similar.  While  our  purpose 
has  been  to  illustrate  a technique,  it  is  clear  from  both  analyses  that  brew 
strength  and  roast  color  have  main  effects  while  brand  interacts  with  brew 
strength  even  though  it  has  no  main  effect. 

Factorial  parameters  may  be  estimated.  Ue  illustrate  using  the  full  factorial 
model  and  £ from  row  2 of  Table  2.  Because  of  the  constraints  on  the  factorial 
parameters  and  the  one  degree  of  freedom  available  for  the  estimation  of  each 
main  effect  or  interaction,  each  main  effect  or  interaction  may  be  obtained  from 
the  vector  -g-  B^Y  (*j)  . Thus 
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TABLE  3 - An  Analysis  of  Chi-  Square  for  the  Coffee  Data 


Hypothesis 

Tested1 

Conditions 

Assumed 

Decrees  of 
Freedom 

Chi 

Square 

No  Fj  offect 

No  F2,  F3>  Mo  interactions 

1 

9.28 

Mo  F2  effect 

Mo  Fj,  Mo  interactions 

1 

4.29 

No  F3  effoct 

No  interactions 

1 

0.04 

No  FjFj,  FjFjj,  F2F3 
interactions 

No  FjF2F3  interaction 

3 

15.34 

No  F2F3  interaction 

Mo  FjFjFj  interaction 

1 

0.22 

No  FjFj  interaction 

Ho  F2F3,  F^jFj  interactions 

1 

14.96 

No  FjF2  interaction 

Ho  FjPj.  F2F3,  FjFjFj 

interactions 

1 

0.15 

No  FjF2F3  interaction 

None 

1 

0.63 

No  treatment  effects 

Hone 

7 

29.58 

Fj  is  brew  strength, 


is  roast  color,  is  brand. 
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TABLE  4 - An  Alternative  Analysis  of  Chi  Sq 


Hypothesis 

Tested1 

Conditions 

Assumed 

No  effect 

None 

Mo  F2  effect 

Ho  effect 

No  Fj  effect 

Mo  F^,  F2  effects 

No  FjF^  FjFj,  F2F3 
interactions 

No  main  effects 

No  F^F^  interaction 

No  main  offocts 

No  FjF3  interaction 

No  main  effects,  No  F^ 
interaction 

No  F2Fj  interaction 

Iio  main  effects.  No  F^, 
FjFg  interactions 

No  PjI!2F3  interaction 

No  main  effects,  Flo  two- 
factor  interactions 

No  treatment  effects 

None 

Fj  is  brew  strength,  F2  is  roast  color,  Fj 


for  the  Coffee  Data 


Degrees  of  Chi 

Freedom  Square 


1 

9.47 

1 

4.33 

1 

0.04 

3 

15.12 

““"1 

_ 

1 

0.16 

1 

14.73 

1 

0.24 

-J 

1 

0.62 

7 

29. 5G 

I 

I 


1 


is  brand. 
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iil  pj  « 0.1534  , in  Pq  - 0.1038  , in  p^  - 0.0096  , in  pJJ  • -0.0196  , 


in  p“  - 0.1924  . h lP“«  -0.0238  . in  = 0.0393  , 


.23 


123 


00 


00 


000 


and 


pj  - 1.1658  , Pq  = 1.1094  , Pq  * 1.0097  , pjg  ■ 0.9806  , 

i • • 

pJJ  - 1.2122  , p”  - 0.9765  , pj”  - 1.0401  . 

These  estimates  are  listed  in  the  same  order  as  the  pertinent  rows  in  B^.  The 
remaining  factorial  parameter  estimates  are  identical  to  or  the  reciprocal  of 
those  shown  for  the  same  effect  or  interaction  depending  on  whether  the  sum  of 

the  subscripts  is  oven  or  odd.  For  exampio,  p*  ■ (1.1658)”1  ■ 0.8578, 

_1 * - 

pJJ  - 0.9806,  pjjjj  • (1.0401)  - 0.9614. 

It  is  seen  that  the  analysis  for  the  factorial  treatment  combinations  in 
paired  comparisons  is  very  similar  to  the  analysis  of  variance  for  factorials.  1 
Interpretations  are  made  in  the  usual  way,  particularly  when  the  logarithms  of 
factorial  parameter  estimates  are  considered. 


7.  CONCLUDING  REMARKS 

The  techniques  of  this  paper  provide  moans  for  much  new  flexibility  in  the 
analysis  of  paired  comparisons  experiments.  Factorial  treatment  combinations 
may  be  used.  Since  specified  treatment  contrasts  may  be  used  generally, 
fractional  factorials  are  available  also.  Special  treatment  contrasts  may  have 
interest  in  special  experimental  situations. 
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It  ha3  been  noted  that  convergence  of  the  iteration  process  given  for 
solution  of  likelihood  equations,  asymptotic  variances  and  covariances  for 
treatment  contrasts,  and  large-sample  properties  of  test  procedures  will  be 
given  in  subsequent  papers.  The  similarity  of  analyses  in  Tables  3 and  4 
suggests  that  conditions  assumed  for  a test  may  not  be  constraining  and  that 
tests  in  the  two  tables  may  be  asymptotically  equivalent.  This  possibility 
will  be  investigated. 
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